Flume案例一:监控 netcat 端口数据案例

您所在的位置:网站首页 flume采集数据到logger sink Flume案例一:监控 netcat 端口数据案例

Flume案例一:监控 netcat 端口数据案例

2024-07-11 02:56| 来源: 网络整理| 查看: 265

本文接上篇博客:Flume介绍、安装、使用案例、自定义Source/Sink、监控 Flume 版本:1.9.0

1.监控 netcat 端口数据案例

选型:netcat source + memory channel + logger sink

文档参考:  netcat-tcp-source:http://flume.apache.org/releases/content/1.9.0/FlumeUserGuide.html#netcat-tcp-source  memory channel:http://flume.apache.org/releases/content/1.9.0/FlumeUserGuide.html#memory-channel  logger sink:http://flume.apache.org/releases/content/1.9.0/FlumeUserGuide.html#logger-sink

2.需求图示

在这里插入图片描述

3.flume配置

flume-netcat-logger.conf

# Name the components on this agent a1.sources = r1 a1.sinks = k1 a1.channels = c1 # Describe/configure the source a1.sources.r1.type = netcat a1.sources.r1.bind = localhost a1.sources.r1.port = 44444 # Describe the sink a1.sinks.k1.type = logger # Use a channel which buffers events in memory a1.channels.c1.type = memory a1.channels.c1.capacity = 10000 a1.channels.c1.transactionCapacity = 10000 a1.channels.c1.byteCapacityBufferPercentage = 20 a1.channels.c1.byteCapacity = 800000 # Bind the source and sink to the channel a1.sources.r1.channels = c1 a1.sinks.k1.channel = c1 4.启动命令 bin/flume-ng agent -c conf -n a1 -f job/flume-netcat-logger.conf -Dflume.root.logger=INFO,console 5.测试图示

netcat 发送数据,flume 端能够正常接收,通过 logger 方式输出,如图所示:

在这里插入图片描述

博主写作不易,加个关注呗

求关注、求点赞,加个关注不迷路 ヾ(◍°∇°◍)ノ゙

我不能保证所写的内容都正确,但是可以保证不复制、不粘贴。保证每一句话、每一行代码都是亲手敲过的,错误也请指出,望轻喷 Thanks♪(・ω・)ノ



【本文地址】


今日新闻


推荐新闻


CopyRight 2018-2019 办公设备维修网 版权所有 豫ICP备15022753号-3